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Abstract 

This  research  investigated  the  relationship  between  the 
adoption  and  effectiveness  of  electronic  mail  at  the  Air 
Force  Institute  of  Technology's  School  of  Systems  and 
Logistics  ( LS ) . 

In  this  research,  theories  concerning  innovation 
adoption  and  measurement  of  system  effectiveness  are 
discussed.  Survey  instruments  from  both  areas  were 
selected,  tested,  and  used  to  collect  data  from  the  LS 
faculty  and  staff.  Correlation  analysis  was  performed  using 
the  data  collected. 

Findings  indicate  a  correlation  does  exist  between  the 
adoption  of  electronic  mail  and  the  effectiveness  surrogate 
measurement,  user  satisfaction.  There  was  a  si-gnif  icantl  y 
strong  negative  correlation  between  electronic  mail 
complexity  and  user  satisfaction. 
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A  STCDY  OP  ADOPTION  AND 
EFFECTIVENESS  OF  ELECTRONIC  MAIL  AT 
THE  AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 

ZatcpdttctAon 

Throughout  history,  there  has  existed  among  the  human 
race  a  desire  to  communicate.  Through  the  centuries 
technol ogical  breakthroughs  have  advanced  us  from  the 
archaic  mea^is  ot  communication  of  the  past.  What  once  took 
months  and  days  can  now  be  done  in  minutes  and  seconds  with 
the  right  equipment. 

In  some  ways  communication  has  not  improved  as  much  as 
we  would  like  to  think.  Many  people  still  spend  a  great 
deal  of  their  time  playing  "phone  tag"  or  chasing  down 
people  to  get  a  message  to  them.  This  can  significantly 
slow  down  communication  and  often  frustrates  the 
communicator  (18:97).  One  technological  advancement  that 
may  alleviate  some  obstacles  is  computer-mediated 
communication. 
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Computer-mediated  communication  is  fast  becoming  a 
mainstay  in  today’s  society.  One  of  the  most  coiranon  and 
widely  used  forms  emerging  is  electronic  mail  (8:48). 
Electronic  mail,  or  e-mail  as  it  is  known,  is  a  message 
system  capable  of  delivering  textual  communications  from  a 
sender  to  one  or  more  recipients  by  an  automated  electronic 
network . 

Many  advantages  can  be  associated  with  the  use  of  e- 

mail.  Flexibility  is  a  key  one  in  that  each  user  is  in 

control.  Mail  is  sent  at  the  convenience  of  the  sender  and 

received  at  the  convenience  of  the  receiver.  Large  or  small 

amounts  of  e-mail  may  be  sent  to  a  local  or  distant 

location,  even  at  the  same  time. 

Computer  mail  is  a  writing  medium,  but  it  is  more 
versatile  than  paper  memoranda  and  postal  mail.  People 
can  exchange  any  text-messages,  documents,  datafiles, 
even  computer  conferences  consisting  of  conversations 
of  many  people.  (8:48) 

There  also  exists  a  potential  for  time-savings.  '*E- 
junk"  can  be  discarded  quickly  and  permanently.  Mechanical 
typewriting  and  correction  of  errors  is  replaced  by  much 
more  efficient  keyboarding.  Multiple  contacting  does  not 
require  the  minutes,  hours,  or  days  consumed  by  phone  calls, 
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meetings,  or  delivery  of  regular  mail.  Retention  and 
reproduction  features  allow  a  particular  message  to  be  sent 
once  and  only  once,  or  as  often  as  desired.  A  user  also  has 
the  capability  of  simultaneous  reception  and  storage  of 
return  messages  in  large  numbers  (15:424). 

The  need  for  precision  in  today's  communication  is  met 
as  e-mail  is  generated  by  a  system  which  is  capable  of 
printing  each  written  character  exactly  the  same  way  every 
time,  which  eliminates  the  necessity  of  decoding  illegible 
handwriting.  Some  tasks  are  programmable,  which  offsets  the 
influence  of  human  fatigue  or  emotional  fluctuation,  which 
in  turn  can  reduce  the  frequency  of  errors.  Mistakes  that 
do  occur  are  more  easily  corrected  as  the  message  is  written 
on  an  electronic  medium  rather  than  a  physical  form 
(15 : 424) . 

Electronic  mail  can  even  replace  paper  for 
communication  and  record-keeping  promoting  better 
organization. 

There  are  no  tangible  artifacts.  Messages  are  composed 
on  and  read  from  video  terminals  (rather  than  teletype 
machines)  with  no  hard  copy  left  behind.  It  is 
possible  to  store  messages  on  computer  files  and  to 
create  hard  copies  of  them,  but  most  messages  are  never 
put  on  paper;  and  if  stored,  they  are  stored 
electronically.  (3:48) 
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The  potential  reduction  of  sloppiness  in  the  working 
environment  can  be  a  major  justification  tor  purchase  of  an 
e-mail  system.  Electronic  records  not  only  require  less 
frequent  physical  replacement  or  correction  than  paper 
records,  but  are  more  easily  changed  when  such  is  needed. 
Electronic  storage  requires  less  physical  space  and  makes 
better  use  of  the  space  it  takes,  compared  with  more 
conventional  methods. 

General  Issue 

With  all  of  these  features  e-mail  could  revolutionize 
communication  within  an  organization,  but  they  do  not 
guarantee  its  success  in  an  organization.  Individual  users 
may  not  be  satisfied  with  the  system  being  used  in  their 
particular  organization.  An  individual  who  is  not  satisfied 
with  e-mail  may  not  use  it,  and  any  advantages  e-nail  may 
have  are  lost  if  the  system  is  not  used. 

Specific  Problem 

The  Air  Force  Institute  of  Technology  has  invested  in 
electronic  mail  systems  that  span  its  organization.  The 
School  of  Systems  and  Logistics  looks  to  e-mail  to  help 
"ensure  open  lines  of  coimnuni cation  in  all  directions"  and 
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"encourage  a  ready  crossflow  of  ideas  between  faculty  and 
administration  (3:19)."  If  its  e-mail  system  goes  unused, 
crucial  budget  money  and  time  may  be  wasted  in  support  of  an 
ineffective  communications  system.  This  could  lead  to 
pertinent  information  failing  to  reach  its  intended 
recipient . 

R?s.^ffch  Objagtive 

The  purpose  of  this  research  is  to  investigate  the 
relationship,  is  any,  between  adopting  an  information 
technology  innovation  and  the  effectiveness  of  an 
information  technology  innovation.  The  specific  innovation 
that  will  be  investigated  is  electronic  mail,  as  used  by  the 
faculty  and  staff  at  the  Air  Force  Institute  of  Technology 
School  of  Systems  and  Logistics. 

Overview 

Chapter  II  begins  with  an  overview  of  the  theory  of 
innovation  diffusion  and  the  development  of  an  instrument  to 
measure  the  characteristics  of  innovation  adoption.  The 
latter  part  of  the  chapter  discusses  the  measurement  of 
information  system  effectiveness.  Chapter  III  outlines  the 
specific  methods  that  will  be  used  in  this  research  to 
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measure  innovation  adoption  characteristics  and  system 
effectiveness.  chapter  IV  examines  the  results  of  these 
measurements  and  Chapter  V  provides  recommendations  and 
conclusions  that  were  drawn  from  this  research. 
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11-  Literature  Review 


This  chapter  begins  with  an  overview  of  the  diffusion 
of  innovation  theory.  A  few  examples  of  where  it  has  been 
used  are  given  and  the  development  of  an  instrument  to 
measure  the  characteristics  of  innovation  adoption  is  then 
discussed.  The  latter  part  of  the  chapter  focuses  on 
effectiveness,  in  the  context  of  information  systems  (IS), 
and  establishes  accepted  measures  for  IS  effectiveness. 

Diffusion  ni  innovation  Theory 

The  diffusion  of  an  iimovation  is  conceptualized  as  the 
process  by  which  knowledge  of  an  innovation  spreads  through¬ 
out  a  population,  eventually  to  be  adopted  or  not,  by  an 
individual,  an  organization,  or  another  decision-making  unit 
in  the  population  (2:162).  When  discussing  the  theory  of 
diffusion  of  innovation,  it  is  important  to  first  establish 
a  definition  of  diffusion.  Everett  Rogers  defines  diffusion 
as  "the  process  by  which  an  innovation  is  coinnunicated 
through  certain  channels  over  time  among  the  members  of  a 
social  system  (13:5).”  An  analysis  of  this  definition 
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identifies  four  distinct  elements  that  the  theory  is 
organised  around:  an  innovation,  consnimi cation,  time,  and  a 
social  system.  To  understand  the  theory,  one  needs  to 
understand  the  four  components  and  the  ways  in  which  they 
relate  (2:162). 

The  definition  of  the  first  element,  the  innovation, 

has  a  very  broad  interpretation.  It  can  be  an  idea,  a 

practice,  or  an  abject  that  appears  new  to  the  individuals 

or  other  units  of  adoption  within  a  social  system 

(2:162,13:11).  They  are  not  necessarily  single  items.  They 

may  be  part  of  a  "technological  cluster,"  one  or  more 

distinguishable  technology  elements  that  are  perceived  as 

being  closely  related  (13:14). 

Diffusion  theory  asserts  that  certain  characteristics 

of  the  innovation  influence  its  rate  of  adoption 

(2:162,13:15).  These  characteristics  include:  relative 

advantage,  compatibility,  complexity,  trialability ,  and 

observability.  Rogers  defines  these  terms  as  follows: 

Relative  advantage  is  the  degree  to  which  an  innovation 
is  perceived  as  better  than  the  idea  it  supersedes; 

Compatibility  is  the  degree  to  which  an  innovation  Is 
perceived  as  being  consistent  with  the  existing  values, 
past  experiences,  and  needs  of  potential  adopters; 
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Complexity  is  the  degree  to  which  an  innovation  is 
perceived  as  difficult  to  understand  and  use; 

Trialability  is  the  degree  to  which  an  innovation  may 
be  experimented  with  on  a  limited  basis;  anri 

Observability  is  the  degree  to  which  the  results  of  an 
innovation  are  visible  to  others.  (13:15-16) 

Rogers  adds  that  there  are  other  characteristics  that  affect 

the  rates  of  adoption,  but  past  research  indicates  that 

these  are  the  most  significant  ones  (13:16). 

The  second  element  of  diffusion  theory  is 

cooBPunication,  "the  creation  and  sharing  of  information 

about  innovations  (2:162).”  Obviously,  comnunication  is 

more  likely  between  individuals  who  are  alike.  This  is 

known  in  diffusion  theory  as  homophily,  "the  degree  to  which 

pairs  of  individuals  who  interact  are  similar  in  certain 

attributes,  such  as  beliefs,  education,  social  status,  and 

the  like  (13:18)."  Communication  is  more  likely  to  be 

effective  and  rewarding  when  two  individuals  are  homophilous 

(13:19). 

Time  is  the  third  aspect  of  the  diffusion  of  innovation 

process.  There  are  three  ways  in  which  time  is  involved  in 

diffusion.  The  first  is  in  the  innovation-decision  process, 

. . .the  process  through  which  an  individual  (or  other 
decision-making  \uiit)  passes  from  first  knowledge  of  an 
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iimovation  to  forming  an  attitude  toward  the 
innovation,  to  a  decision  to  adopt  or  reject,  to 
implementation  of  the  new  idea,  and  to  confirmation  of 
this  decision.  (13:20) 

These  five  steps  usually  occur  in  sequence  and  the  length  of 
time  required  for  this  process  is  referred  to  a?  the 
innovation-decision  period  (13:21). 

The  second  way  that  time  is  involved  is  identified  as 
innovativeness.  This  refers  to  the  amount  of  time  involved, 
relative  to  other  members  of  the  social  system,  for  an 
individual  to  adopt  new  ideas.  Adopter  categories  identify 
members  of  the  social  system  based  on  their  innovativeness. 
The  adopter  categories  include:  innovators,  early  adopters, 
early  majority,  late  majority,  and  laggards  (13:22). 

Specific  variables  such  as  socioeconomic-status  levels, 
personality,  and  comnunication  behaviors,  are  associated 
with  each  of  the  categories  (2:163).  Each  category  plays  a 
role  in  the  flow  of  ideas  through  the  given  social  system 
and  can  identity  how  comnunication  can  be  tailored  to  each 
audience  (2:163,13:22). 

The  third  way  time  is  involved  is  the  relative  speed  in 
which  members  of  the  social  system  adopt  an  innovation.  The 
rate  of  adoption  is  usually  measured  by  the  length  of  time 
required  for  a  certain  percentage  of  social  system  members 
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to  adopt  the  innovation.  (13:23).  Different  innovations  will 
have  different  rates  of  adoption  within  a  social  system, 
just  as  there  will  be  differences  in  the  rate  of  adoption 
for  the  same  innovation  in  different  social  systems. 

Innovations  that  are  perceived  as  possessing  high  degrees  of 
the  five  innovation  characteristics  will  have  a  more  rapid 
rate  of  adoption  (13:23). 

The  fourth  and  final  component  of  the  organization  of 
diffusion  theory  is  the  social  system.  It  is  comprised  of  a 
set  of  interrelated  individuals,  units,  or  organizations 
using  collective  problem  solving  to  accomplish  a  common 
purpose  (2:164,13:24).  A  social  system  has  social  structure 
and  communication  structure.  Social  structure  is  the 
"patterned  social  relationships  among  the  members  of  a 
system"  while  communication  structure  is  "the  differentiated 
elements  that  can  be  recognized  in  the  patterned 
communication  flows  in  a  system  (13:25).”  These  structures 
influence  the  diffusion  of  innovations  in  the  social  system. 

There  are  many  other  influences  to  diffusion  within  a 
social  system.  One  of  which  is  the  established  behavior 
patterns  or  norms  of  the  system  members.  Another  influence 
is  the  type  of  innovation-decisions  that  must  be  made. 
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These  types  include: 

Optional  innovation~decisions,  choices  to  adopt  or 
reject  an  innovation  that  are  made  by  an  individual 
independent  of  the  decisions  of  other  members  of  the 
system; 

Collective  innovation-decisions/  choices  to  adopt  or 
reject  an  innovation  that  are  made  by  consensus  among 
the  members  of  the  system; 

Authority  innovation-decisions,  choices  to  adopt  or 
reject  an  innovation  that  are  made  by  relatively  few 
individuals  in  a  system  who  possess  power  status,  or 
technical  expertise;  and 

Contingent  innovation-decisions,  a  sequential 
combination  of  two  or  more  of  these  types  in  which 
choices  to  adopt  or  reject  can  be  made  only  after  a 
prior  innovation-decision.  (13:37) 

Another  way  in  which  the  social  system  is  involved  in 
the  diffusion  of  innovations  is  the  consequences  of  the 
innovations.  Consequences  are  the  changes  that  occur  to  the 
social  system,  or  an  individual  within  the  social  system,  as 
a  result  of  the  adoption  or  rejection  of  eui  innovation 
(13:37) . 

An  innovation  has  little  effect  imtil  it  is  distributed 
to  members  of  a  system  and  put  to  use  by  them.  Thus, 
invention  and  diffusion  are  but  meams  to  an  ultimate 
end:  the  consequences  from  adoption  of  an  innovation. 

(13:371) 

Many  researchers  have  given  little  attention  to  the  study  of 
consequences,  often  assuming  that  adoption  of  an  innovation 
will  produce  only  beneficial  results.  This  assiimption. 
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known  as  the  pro-innovation  bias,  is  obviously  a  false  one. 
"Every  innovation  produces  social  and  economic  reactions 
that  run  throughout  the  social  structure  of  the  client 
system  (13:372),"  Not  all  of  these  reactions  are  of  a 
positive  nature  (13:372-374). 

This  section  has  looked  at  the  diffusion  of  innovations 
and  defined  the  four  main  elements  that  it  is  organized 
around;  the  innovation,  communication,  time,  and  the  social 
system.  The  next  section  will  address  areas  in  which  it  has 
been  applied. 

Areas  ^  Dse .  "The  two  most  important  disciplines  in 
the  early  years  of  diffusion  of  innovation  studies  were 
anthropology  and  sociology  (9:13)."  Anthropology  viewed  it 
as  an  explanation  of  the  social  change  brought  about  by 
innovations  introduced  from  outside  the  society  or  social 
system.  These  studies  showed  that  the  probability  of 
adoption  increases  relative  to  the  degree  of  the 
innovation's  compatibility  with  the  particular  culture. 

While  research  in  these  areas  declined  in  the  1950s,  other 
academic  disciplines  became  interested  in  diffusion  theory. 
These  areas  included  education,  medicine,  rural  sociology 
and  agriculture  (9:13,14). 
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Education,  studies  typically  looked  at  teaching/ learning 
techniques  and  innovations  such  as  team  teaching,  programmed 
instruction,  and  modern  math.  This  final  area  encompasses 
"the  best  piece  of  educational  diffusion  research,"  Doctor 
Richard  Carlson's  1965  study  of  how  modern  math  spread 
through  Pennsylvania  and  West  Virginia  school  administrators 
(13:64).  In  this  study  he  analyzed  the  leadership  opinion 
patterns  in  the  diffusion  networks  among  superintendents. 

This  focus  on  interpersonal  networks  in  diffusion  was  a 
great  step  forward,  but  the  most  interesting  point  to  emerge 
is  that  educational  innovations  seem  to  take  much  longer  to 
diffuse  than  do  medical  or  agricultural  innovations.  One 
reason  suggested  for  this  difference  is  the  lack  of  change 
agents  to  promote  new  ideas  in  the  educational  circles. 
"Teachers  are  not  subject  to  the  promotional  material  and 
the  attentions  of  sales  people  to  the  same  extent  as  farmers 
and  doctors  (9:13)." 

The  medical  and  agricultural  disciplines  have  become 
very  concerned  with  the  diffusion  of  innovations.  One  of 
the  most  noted  studies  in  rural  sociology  and  agriculture 
was  the  Ryan  and  Gross  study  of  the  diffusion  of  hybrid  seed 
corn  (9:13,13:32).  "It  is  an  ideal  illustration  because  the 
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hybrid  corn  investigation,  includes  each  of  the  four  main 
elements  of  diffusion  (13:32)." 

An  important  diffusion  study  of  a  medical  innovation 
was  carried  out  in  1954  at  Columbia  University.  This  study 
was  concerned  with  a  new  antibiotic  and  its  diffusion  among 
doctors  in  four  Illinois  cities.  Other  studies  have  looked 
at  the  diffusion  of  new  vaccines,  health  practices,  and 
family  planning  practices,  especially  in  the  third  world. 

More  recently,  though,  the  potential  applicability  of 
the  diffusion  of  innovation  theory  to  problems  related  to 
the  adoption  of  technological  ixinovations  has  been  suggested 
(2:161,11:1) . 

Instrument  Development .  "The  adoption  of  information 
technologies  by  individuals  and  organizations  is  part  of  the 
process  of  information  system  implementation  (11:1)."  This 
is  an  area  receiving  a  lot  of  recent  attention,  but  still 
lacking  in  many  areas.  In  their  paper,  "Development  of  an 
Instrument  to  Measure  the  Perceived  Characteristics  of 
Adopting  an  Information  Technology  Innovation,"  Moore  and 
Benbasat  point  to  several  factors  that  "have  plagued  IS 
research  (11:1)."  Two  of  the  most  serious  ones  are  the  lack 
of  a  "cumulative  tradition  in  IS"  and  "poor  theory 
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development  They  further  point  out  the  inadequate 

measurement  of  constructs  and  that  without  good  theory  there 

cannot  be  well  defined  constructs.  Nor  can  there  be 

operationalization  of  these  constructs,  all  of  which  are 

prerequisites  "for  the  beginning  of  a  cumulative  tradition 

(11:1)."  In  order  to  overcome  these  weaknesses  in  IS 

research,  Moore  and  Benbasat,  as  well  as  others,  are  looking 

to  the  theories  of  innovation  diffusion  (11:1). 

Moore  and  Benbasat  tested  the  five  characteristics  of 

an  innovation  identified  by  Rogers,  relative  advantage, 

compatibility,  complexity,  trialability ,  and  observability 

(13:15-16)  plus  two  others  they  felt  were  needed.  The  first 

was  image,  defined  as  "the  degree  to  which  use  of  an 

innovation  is  perceived  to  enhance  one’s  image  or  status  in 

one's  social  system  (11:4)."  The  other  was  voluntariness  of 

use,  defined  as  "the  degree  to  which  use  of  the  innovation 

is  perceived  as  being  voluntary,  or  of  free  will  (11:4).” 

Prom  their  testing  Moore  and  Benbasat  determined  to 

slightly  modify  the  characteristic  definitions. 

Rogers'  definitions  are  based  on  perceptions  of  the 
innovation  itself,  and  not  on  perceptions  of  actually 
using  the  innovation. . .  innovations  diffuse  because  of 
the  cumulative  decisions  of  individuals  to  adopt  them. 
Thus,  it  is  not  the  potential  adopters’  perception  of 
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the  innovation  itselt,  but  rather  their  perceptions  of 
using  the  innovation  that  are  key  to  whether  the 
innovation  diffuses.,.  Thus,  all  characteristics  were 
redefined  in.  terms  of  potential  adopters  use,  trial  or 
observation  of  the  innovation,  and  labeled  the 
Perceived  Characteristics  of  Innovating  (PCI).  (11:5) 

After  a  literature  search  for  previously  developed  and 

evaluated  tests/scales  for  each  characteristic,  Moore  and 

Benbasat  developed  and  tested  an  overall  instrument  to 

measure  all  PCI.  Although  the  instrument  was  developed  and 

tested  with  a  specific  information  technology  (IT) 

innovation,  the  personal  work  station,  the  authors’  support 

the  idea  of  substituting  other  IT  innovations  into  the 

instrument  (11:20).  This  will  be  done  for  this  thesis. 

Further  discussion  of  the  actual  instrument  will  take  place 

in  chapter  III. 

Measuring  the  characteristics  of  adopting  e-mail  is 
only  the  first  part.  Determining  whether  innovation 
adoption  and  its  characteristics  are  correlated  with  system 
effectiveness  is  the  ultimate  goal  of  this  research.  The 
next  section  of  this  chapter  discusses  system  effectiveness, 
in  terms  of  information  systems,  and  acceptable  surrogate 
measurements  for  system  effectiveness. 
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Measuring  SystjeiD  Effectiveness 

Finding  a  way  to  measure  the  effectiveness  of 
information  systems  technology  has  been  a  difficult  and  on 
going  struggle  (14 ; 243 , 16 :203 ,12 : 173 ) •  Many  approaches  smd 
surrogate  measures  have  been  suggested.  "The  spectrum  of 
approaches  that  have  been  suggested  to  deal  with  this 
complex  issue  presents  a  bewildering  array  to  a  researcher 
(14:243)."  Approaches  that  have  been  suggested  include 
economic  analyses,  such  as  cost-benefit  zmalysis,  actual 
usage,  and  user  perceptions.  Srinivasan  acknowledges  the 
importance  of  the  economic  analyses,  but  states  that  the 
focus  of  much  of  the  literature  is  on  usage  or  user 
perceived  effectiveness  (14:243). 

In  his  article  on  finding  a  measurement  of 
effectiveness,  Oinzberg  argues  that  "'use,'  by  itself,  is  an 
inadequate  measure  of  effectiveness  (4:59)."  Melone  adds, 
in  her  article,  "A  Theoretical  Assessment  of  the  User 
Satisfaction  Construct  in  IS  Research,"  that  "user 
satisfaction  alone  is  not  sufficient  to  adequately  capture 
the  full  meaning  of  effectiveness  (10:88)."  "It  is  apparent 
that  both  system  usage  and  user  perceived  effectiveness  play 
roles  in  determining  the  effectiveness  of  an  MIS  (14:244). 
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A  positive  association  between  usage  and  satisfaction  has 
also  been  consistently  observed  (19:923);  therefore,  use  of 
both  approaches  may  be  warranted  in  many  situations  (14:244, 
7:786) . 

User  Satisfaction.  "The  literature  generally  agreed 
that  satisfaction  in  a  given  situation  is  the  sum  of  one's 
feelings  or  attitudes  toward  a  variety  of  factors  affecting 
that  situation  (1:531)."  The  Bailey/Pearson  article, 
"Development  of  a  Tool  for  Measuring  and  Analyzing  Computer 
User  Satisfaction,"  from  which  this  quote  is  taken,  is 
considered  one  of  the  benchmarks  tor  user  satisfaction  study 
(10:76,16:203,5:740,7:785) . 

In  their  article,  Bailey  and  Pearson  established 
thirty-nine  factors  that  affect  user  satisfaction  with 
computers,  and  developed  a  questionnaire  to  measure 
satisfaction  from  them.  Flexibility  of  the  questionnaire  is 
a  major  aspect  of  this  instrument.  It  is  possible  to  use 
only  a  preselected  number  of  the  thirty-nine  factors,  rather 
than  all  of  them,  for  a  specific  situation.  In  addition, 
questions  can  be  made  clearer  for  a  specific  situation  by 
using  user  community  vocabulary  (1:539).  Bailey  and  Pearson 
recotnnended  future  development  of  their  measurement 
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instrument.  Ives,  Olson,  and  Baroudi  were  one  of  the  first 
groups  to  undertake  that  mission. 

In  their  study,  Ives,  Olsen,  and  Baroudi  were 
interested  in  finding  a  sound  tool  for  the  measurement  of 
user  information  satisfaction.  They  reviewed  four  measures 
and  selected  the  Bailey/Pearson  measure  because  it  best  met 
their  requirements  of  being  an  "empirically  derived  measure, 
with  adequate  empirical  support,  which  covers  both  the 
information  system  product  and  general  system  services  and 
provides  multiple  indicators"  (7:788). 

The  rest  of  their  paper  was  devoted  to  assessing  "the 
validity  and  reliability  of  [Bailey  Pearson's  measure  and 
to  refine  it  for  use  in  research  and  practice"  (7:788). 

They  conclude  their  article  with  the  feeling  that  their  work 
has  helped  produce  a  better  instrument  and  they  encourage  to 
the  MIS  research  community  "to  choose  a  standard  instrument" 
(7:792) . 

Louis  Raymond  selected  the  Ives  et  al  modified 
Bailey/Pearson  measure.  He  based  this  selection  on  four 
criteria : 

1)  The  instrument  should  not  only  measure  user 
attitudes  toward  the  MIS  product,  but  also  toward 
MIS  services;  2)  The  instrument  should  be  oriented 


20 


5  1  £  5  g  4  5 


Ph'.tF  .  OOP 


02  13  92 


12;  IS 


ff513  253  845S 


AFIT  IS  HPaFB.OH 


®002'010 


toward  implementation  of  organizational  MIS  rather 
than  the  development  of  specific  subsystems;  3)  The 
instrument  should  be  usable  across  organizations; 
and  4)  The  instrument  should  be  short  and  easy  to 
answer.  (12:174) 

In  his  study  he  broadened  the  domain  of  reliability  and 
validity  of  the  instrument  and  developed  it  to  contribute 
further  to  "a  better  understanding  of  the  specific  aspects 
of  small  organizations  in  regards  to  information  systems 
(12:178).”  Increased  knowledge  of  the  MIS  success  factors 
is  needed,  concluded  Louis,  "if  organizations  are  to  respond 
effectively  to  the  unique  problems  and  opportunities  which 
confront  them  (12:175)." 

Tam  and  Tak  recognized  this  need  also.  Their 
evaluation  of  previously  developed  instruments  that  measure 
user  satisfaction  "led  to  the  selection  of  that  of  Pearson 
and  Bailey"  also  (16:204).  They  chose  to  modify  it 
themselves  by  using  only  thirty-three  of  the  thirty-nine 
original  factors  and  by  modifying  some  of  the  factor  titles. 
One  other  significant  change  to  the  measure  was  the  use  of  a 
seven-point  Likert  scale,  instead  of  the  original  semantic 
differential  scale.  A  measurement  study  was  done  to 
investigate  the  reliability  and  validity  of  the  modified 
instrument.  Tan  and  Tak  concluded,  much  like  Louis,  that 
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their  study  had  “broadened  the  applicability  of  the 
measurement  instrument  (16:208).” 

Hiltz  and  Johnson,  however,  write  that  the  factors  used 
in  the  Bailey/ Fears on  instrument  are  "generally  not 
applicable  to  computer-mediated  communication  systems  as 
contrasted  to  management  information  systems  (5:740).”  They 
do  agree  with  Bailey  and  Pearson  that  "an  accepted  measure 
of  user  satisfaction  is  clearly  needed"  and  their  work 
"identifies  the  factors  which  comprise  subjective 
satisfaction  with  computer-mediated  communication  systems 
(5:739).*'  They  use  an  instrument  designed  specifically  to 
investigate  the  determinants  of  acceptance,  of  which 
subjective  satisfaction  is  a  dimension,  of  computer-mediated 
communication  systems  (6:i).  it  is  from  this  instrument 
that  an  instrument  will  be  developed  for  this  thesis. 

Further  discussion  of  the  actual  instrument  will  take  place 
in  Chapter  III. 

As  mentioned  earlier  in  this  section,  user  satisfaction 
is  by  no  means  the  only  accepted  surrogate  measure  of 
effectiveness.  The  concluding  section  of  this  chapter  will 
briefly  discuss  actual  use  of  a  system  as  a  means  of 
determining  system  effectiveness. 
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Osage .  "Utilization  of  an  information  system  is  an 
important  and  frequently  measured  MIS  variable,  since  use  of 
a  system  is  the  conduit  through  which  information  technology 
can  affect  performance  (17:227)."  In  his  work,  "Utilization 
as  a  Dependent  Variable  in  MIS  Research,"  Trice  reviews  the 
existing  research  literature  and  determines  that  "the 
linkages  between  utilization  and  its  determinants  are  not 
well  understood  (17:235)."  He  asks  the  question,  "How  can 
the  determinants  of  utilization  be  better  understood 
(17:236)?"  One  of  the  first  steps  is  to  choose  a  definition 
of  utilization,  but  there  are  many  different  ones  (17:236). 

"One  consequence  of  the  lack  of  consistency  in  utilization 
definitions  in  MIS  research  is  the  lack  of  consistency  of 
utilization  measures  as  well  (17:236)."  In  order  to  adopt 
standard  measures  a  standard  definition  is  needed  and  "this 
is  inappropriate  since  utilization  is  process  dependent 
(17:236)."  Trice’s  solution,  or  "the  best  we  can  hope  for", 
is  to  "adopt  standardized  measures  within  the  context  of  a 
single  theory  based  on  the  definition  of  utilization  the 
reference  theory  suggests  (17:236)." 

Another  issue  of  concern  is  the  use  of  objective 
utilization  measures. 


Even  though  machine  usage  statistics  are  routinely 
logged  and  readily  accessible  (at  least  in  the  case  of 
mainframe  computer  systems),  thus  far  they  have  been 
employed  far  less  frequently  than  self-reported 
measurements  in  the  literature.  It  is  recommended 
that  researchers  use  machine  usage  measures  rather  tha.: 
the  mere  subjective  self-reported  measures  whenever 
possible,  since  as  a  rule  objective  measures  ar r  mccr 
accurate.  Care  must  be  exercised  in  the  selection  of 
objective  machine  usage  measures,  however. 

'.z  Trice  and  Trency  point  out,  the  routinely  Icgg-i 

_aqe  statistics  are  not  always  dir  ;ctly  appli“rblr 

giver,  research  problem.  In  this  study,  usage  rr.ea_'...  .  ■ 
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In':roductiQP 

This  chapter  outlines  the  methods  used  to  address  the 
specific  problem  stated  in  Chapter  I.  It  first  discusses 
the  population  of  interest,  then  addresses  the  method  used 
to  collect  data  in  the  two  areas  of  concern:  the 
characteristics  of  innovation  adoption  and  system 
effectiveness,  and  concludes  with  a  focus  on  how  this  data 
will  be  correlated. 


The  population  of  interest  for  this  research  is  the 
faculty  and  staff  of  the  Air  Force  Institute  of  Technology 
Schoc!  of  Systems  and  Logistics  (AFIT/LS;.  Tince  this  is  a 
relatively  small  (150),  accessible  group,  a  census  was 
possible.  The  only  potential  problem  anticipated  with 
collecting  data  on  the  entire  population  was  the  level  cf 


r  es pendente . 


Innovation  Adoption.  A  survey  instrtunent  developed  by 
Moore  and  Benbasat  was  used  to  collect  data  on  the  various 
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perceptions  the  AFIT/LS  faculty  and  staff  had  on  adopting 
electronic  mail  as  a  means  of  communication.  This 
instrument  was  developed  for  the  express  purpose  of 
collecting  data  on  the  perceptions  an  individual  may  have  of 


adop’ 


I  information  technology  (IT)  innovation,  and  is 


intended  as  a  tool  for  studying  IT  adoption  and  diffusion 
within  organizations  (11:10). 

Items  to  measure  the  characteristics  were  both  newly 
created  as  well  as  drawn  from  existing  instruments.  All 
items  were  placed  in  a  common  pool  and  subjected  tc  four  - 


■■■■■■  :l 


rounds  of  sorting  procedures  to  establish  what  items  should 
be  in  the  various  scales.  The  objective  of  the  sorting  was 
to  verify  the  validity  of  the  scales  as  part  of  th_ 


Je  /  ?1 opment  process,  Moore  and  Benbasat  did  this  by 


e;:aminir.g  how  groups  of  judges  sorted  the  items  into  various 


ocnstruct  categories.  Scales  for  the  resulting  oonstraobs 
were  subjected  to  three  separate  field  tests.  Following  the 
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reliability.  Moore  and  Benbasat  further  checked  validity 
:u.ng  factor  analysis.  The  result  was  a  thirty-six  question 
innovation  adoption  survey  instrument,  comprising  seven  ‘ 


scales  (Appendix  A:  Part  II) 
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Moore  and  Benbasat’s  original  instr\unent  was  developed 

using  personal  work  stations  (PMS)  as  the  innovation.  For 

the  purposes  of  this  research,  the  instrument  has  been 

modified  to  reflect  electronic  mail  as  the  innovation.  It 

was  pretested  by  surveying  20  APIT  students.  Adjustments 

were  made  based  on  respondents’  comments. 

Pser  Satisfaction.  A  survey  instrument  developed  by 

Hiltz,  Kerr,  and  Johnson  was  used  to  collect  data  on  the 

subjective  satisfaction  the  APIT/LS  faculty  and  staff  had  of 

e-mail  as  a  means  of  communication.  This  instrument 

consists  of  fourteen  items  used  in  Hiltz,  Kerr,  and 

Johnson's  acceptance  follow-up  questionnaire  that  dealt 

specifically  with  probing  "the  users'  reaction  to  the  system 

as  a  means  of  communication  and  work"  (5:749). 

All  items  had  been  used  in  previous  computer -media ted 

conmiuni  cat  ions  studies.  Item  analysis  indicated  that  each 

of  the  fourteen  had  produced  acceptable  variability  and 

internal  validity.  Principal  axis  factor  analysis  was  used 

to  identify  dimensions  or  constructs  that  underlie  these 

items.  Hiltz,  Kerr,  and  Johnson  state: 

There  is  no  generally  accepted  coefficient  to  measure 
the  reliability  of  factor  scales  based  upon  principal 
axis  factor  analysis.  However,  the  coefficient  Omega 
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does  provide  an  overall  estimate  of  the  reliability  of 
all  the  common  factors  in  a  given  set.  (5:749) 

For  the  factor  structures  for  their  data,  "Omega  was  an 

acceptably  high  0.918  (5:749)." 

Data  Analysis 

Cronbach's  alpha  was  calculated  as  a  reliability  check 
of  each  group  of  variables.  Means  and  standard  deviations 
were  also  computed.  Correlation  analysis,  using  a  .05 
significance  level,  was  used  to  address  the  specific 
research  objective. 

Summary 

This  chapter  has  esamined  the  methods  used  for  this 
research.  The  population  of  interest  is  defined.  The 
measurement  instrument  used  and  its  validation  are 
discussed.  Also,  reliability  and  the  analysis  techniques  to 
be  used  in  Chapter  IV  are  presented. 
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JV.  Results 


Introduction 

This  chapter  discusses  the  results  yielded  by  the 
survey  instrument  and  the  statistical  procedure  that  will  be 
used.  Break  outs  of  the  responses  by  demographic  categories 
are  displayed,  as  are  the  means  and  standard  deviations  to 
each  question.  Reliability  of  the  instrument  is  discussed 
and  the  Cronbach's  alphas  of  each  variable  grouping  are 
displayed.  The  chapter  winds  up  with  a  short  description  of 
the  analysis  technique  that  was  used  on  the  data. 

Survey  ReSUltS 

Of  the  150  survey  instruments  sent  out,  87  were 
returned  within  14  days.  Of  these  87  received  back,  four 
were  returned  not  completed  due  to  personnel  absences,  and 
three  were  unusable  due  to  inadequate  responses  in  Sections 
II  and  III.  This  left  a  total  of  80  usable  responses  (53.3% 
usable  response  rate)  to  make  up  the  database. 

The  demographic  breakout  of  the  respondents  is  shown  in 
Tables  1  through  9.  The  variables  from  both  sections  are 
shown  in  Tables  10  and  11  with  their  means  and  standard 
deviations.  The  raw  data  is  contained  in  Appendix  B. 
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TABLE  1 

SURVEY  BREAKOUT  BY  MILITARY  BRANCH 


BRANCH 

number 

PSRCEHTAfiE 

AIR  FORCE 

35 

43.75 

ARMY 

1 

1.25 

NAVY 

3 

3.75 

NOT  APPLICABLE 

40 

50.00 

MISSING  RESPONSES 

1 

1.25 

TOTAL 

80 

100.00 

TABLE  2 

SURVEY  BREAKOUT  BY  DESIGNATION 

DESIGNATION 

NUMBER 

PERCENTAGE 

CIVILIAN 

40 

50.00 

ENLISTED 

2 

2.50 

OFFICER 

37 

46.25 

MISSING  RESPONSES 

1 

1.25 

TOTAL 

80 

100.00 

TABLE  3 

SURVEY 

BREAKOUT  BY 

GENDER 

GENDER 

NUMBER 

£SR£E«ZaG£ 

FEMALE 

13 

16.25 

MALE 

67 

83.75 

TOTAL 

80 

100.00 
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TABLE  4 

SURVEY  BREAKOUT  BY  AGE 


AGE  GROUP 

NUMBER 

PERCENTAGE 

21  -  30 

8 

10.00 

-  !0 

26 

32 . 50 

41  -  50 

24 

30.00 

51  -  GC 

13 

16.25 

OVER  60 

9 

11.25 

TOTAL 

120.00 

TABLE  5 


SURVEY  BREAKOUT  BY  HIGHS 

ST  EDUCATION 

LEVEL 

LEVEL  OF  EDUC.AT:?!' 

NUMBER 

PERCE!!"’ 

H:g:;  SCHOOL  DIPLO.MA  OR  GED 

A 

5.0^ 

SOME  OOLSEGE,  2UT  V.O  SEGHES 

6 

7.50 

ASSO'^IATE'S  DEGREE 

2 

r  n 

SAl'EELOR  '  S  DEGREE 

1 

1.25 

.MASTER'S  DEGREE 

27 

3  3.75 

GR.ADIMGE  Wf'RK  P.AST  M.ASTER '  S 

9 

1  1  .  "  3 

rCCTCEAL  DEGREE 

30 

37 . : ^ 

.■■«:~.G!.VG  .RESPONSES  ' 

•» 

1.25 

30 

IOC .00 

31 
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TABLE  6 


SURVEY  BREAKOUT  BY  ACADEMIC  RANK 


NUMBER 

PERCENTA 

INSTRUCTOR 

15 

18.75 

ASS IS  PROF 

25 

31.25 

ASSOC  PROF 

14 

17 . 50 

PROFESSOR 

11 

13.75 

NOT  APPLICABLE  (STAFF) 

14 

17.50 

MISSING  RESPONSES 

1 

1.25 

TOTAL 

80 

100.00 

TABLE  7 


SURVEY  BREAKOUT  BY  PRCGRA.MO  TAUGHT 


PPCORAM 

PCE  ONLY 
MOSTLY  PCE 

EQUAL  PCE  AND  GRADUATE 
MOSTLY  GRADUATE 
GRADUATE  ONLY 
NOT  APPLICABLE  (STAFF) 
MISSING  RESPONSES 


1UMBER 

RERCENTAG 

14 

17  .  50 

20 

2  5.00 

2 

2.5? 

14 

17.50  • 

15 

18.7  5 

14 

17 . 50 

]_ 

1.25 

"A 

..  J 

IQC  .  C2 

32 


TABLE  8 


SURVEY  BREAKOUT  BY  YEARS  AT  AFIT 


YEARS 

NUMBER 

PERCENTAGE 

LESS  THAN  01 

12 

15 . 00 

01  -  02 

6 

7 . 50 

02  -  04 

19 

2  "5 . 5 

04  -  05 

7 

3.75 

05  -  10 

20 

25.00 

10  -  15 

3 

3.75 

15  -  20 

3 

nr. 

OVER  20 

9 

11.25 

MISSING  RESPONSES 

1 

1.25 

TOTAL 

80 

100.00 

.  TABLE  9 

SURVEY  BREAKOUT  BY  SYSTEM  USED  FUR  E  MAIL 


SYSTEM 

PERCENTAG 

BLACKBIRD  (SSC) 

2 

2 . 50 

CLUSTER  (ISC  OR  CSC) 

6 

7 . 50 

GALAXY  (LCC) 

1 

1.25 

THANTCM  ^ 

57 

83 . 80 

OTHER 

2 . 50 

DO  NCT  USE  E-MAIL 

n 

2  .  50 

TOTAL 

30 

100.00 
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TABLE  10 


SECTION  II  MEANS  AND  STANDARD  DEVIATIONS 


OUESTION 

1  NAME 

NUMBER 

MEAN 

10 

RAl 

80 

4.7750 

1 . 5989 

11 

RA2 

80 

4.1125 

1.3870 

12 

RA3 

80 

4.5750 

1.5518 

13 

RA4 

80 

4.1500 

1.5352 

14 

RA5 

79 

4.8431 

1.5571 

15 

RA6 

80 

4.4250 

1.5490 

16 

RA7 

80 

4.0125 

1 .  5-791 

17 

RA3 

80 

4.4000 

1.7255 

18 

VOLl 

79 

3 . 1139 

1.7758 

19 

VOL2 

79 

4.7722 

1 . 9279 

20 

VOL3 

79 

4.0886 

2.0828 

VOL  4 

79 

4.2785 

2.1058 

22 

COMl 

80 

4 . 0  7  5  C 

1.S744 

23 

COM2 

■’  3 

4.3033 

1 . 8352 

24 

COM3 

80 

4.7875 

1.6202 

C 

COM4 

80 

4.7750 

1 . 5G 

26 

PLEXl 

80 

4.2625 

1.3674 

'  27 

PLEX2 

GO 

3.1500 

■»  •  ^  '-V  T 

1.  .  1  -7  ^  X 

23 

PLEX3 

70 

4.5063 

7  o  O 

X  .  -■  'J  / 

PLXX4 

80 

4.1375 

1.4989 

30 

PLEX5 

80 

3 .8625 

1 . 5157 

31 

PLEX6 

80 

3.4750 

1 .  5583 

32 

SEEl 

78 

4.8718 

1 . 4715 

3  3 

SEE2 

78 

4. 3846 

1 . 8392 

34 

SEE3 

79 

4.7215 

1.7092 

35 

SEE4 

7  9 

4 . 4937 

1. 5096 

36 

SEE5 

79 

4 . 4430 

1 . 6072 

*7  7 

3ZS6 

7  9 

4.3431 

1 . 5020 

n 
^  <J 

AVAILl 

79 

5.5315 

1 . 2993 

39 

AVAIL2 

79 

•  3.8987 

1  .  ~'.12  2 

40 

AVAILS 

78 

3.7051 

1 .7309 

41 

AVAIL4 

79 

3 , 3987 

1.8158 

42 

IMAGEl 

79 

3.3671 

1.7481 

43 

I  MAGE  2 

30 

2 . 9500 

1.7639 

44 

I  MAGE 3 

79 

3 . 1646 

1.7934 

45 

IMAGE 4 

80 

2 . 9375 

1 . 5365 
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TABLE  11 

SECTION  III  MEANS  AND  STANDARD  DEVIATIONS 


QUESTION  » 

name 

NUMBER 

MEAN 

STD  DEV 

46 

OVERALL 

80 

4.3125 

1.2984 

47 

STIM 

80 

3.8000 

1.2569 

48 

UNDER 

79 

4.1139 

1.5606 

49 

COURT 

79 

3.9620 

1.2449 

50 

HARD 

80 

3.8250 

1.5159 

51 

IMPER 

80 

3.7500 

1.1960 

52 

FROST 

80 

3.6750 

1.4122 

53 

HASTE 

80 

4.3500 

1.S679 

54 

UNPRO 

80 

4.6625 

1.3402 

55 

DISTRACT 

78 

3.9231 

1.4484 

56 

CONSTRA 

77 

3.9610 

1.4368 

57 

OVERLOAD 

78 

4.0769 

1.6098 

58 

express 

76 

4.2632 

1.4456 

59 

IMPRESS 

77 

3.8701 

1.4541 

Reliability 

To  assess  the  reliability  of  the  measures  used  in  each 
section,  the  Cronbach's  alpha  procedure  was  used.  Variables 
in  Section  II,  Adoption  of  Electronic  Mail,  were  grouped 
into  the  seven  innovation  adoption  categories:  Relative 
Advantage  (RA) ,  Voluntariness  (VOL),  Compatibility  (COM), 
Complexity  (PLEX) ,  Observability  (SEE),  Trialability 
(AVAIL),  and  Image  (IMAGE).  The  variables  were  also  tested 
as  a  whole  using  the  variable  name  ADOPT.  The  reliabilty 
coefficients  for  Section  II  are  shown  in  Table  12. 
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Variables  front  Section  III  were  tested  in  three  groups. 
Group  one,  OVER,  consisted  of  questions  46  through  49  which 
all  dealt  with  overall  satisfaction  with  electronic  mail. 
Group  two,  REACT,  consisted  of  questions  50  through  54  which 
all  dealt  with  specific  reactions  to  using  electronic  mail. 
The  final  group,  PELT,  consisted  of  questions  55  through  59 
which  all  dealt  with  feelings  about  using  electronic  mail. 
The  variables  were  also  tested  as  a  whole  group  with  the 
variable  name  SATISFY.  The  reliability  coefficients  for 
Section  III  are  shown  in  Table  13. 

The  reliability  of  the  survey  instrument  to  measure 
innovation  adoption  and  user  satisfaction  is  quite  strong  as 
indicated  by  the  Cronbach's  alphas  displayed. 


TABLE  12 

SECTION  II  RELIABILITY  COEFFICIENTS 


NAME 

DESCR1PT.LQH 

COEFFICIENT 

RA 

RELATIVE  ADVANTAGE 

0.969 

VOL 

VOLUNTARINESS 

0.849 

CON 

COMPATIBILITY 

0.929 

FLEX 

COMPLEXITY 

0.894 

SEE 

OBSERVABILITY 

0.774 

AVAIL 

TRIALIBILITY 

0.839 

IMAGE 

IMAGE 

0.894 

ADOPT 

SECTION  II  AS  A  WHOLE 

0.821 
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TABLE  13 


SECTION  III  RELIABILITY  COEFFICIENTS 


OVER  OVERALL  IMPRESSION  0.814 
REACT  REACTION  TO  SPECIFICS  0.876 
FELT  FEELINGS  ABOUT  USING  0.501 
SATISFY  SECTION  III  0.891 


The  correlation  procedure  on  Statistical  Analjsis 
Software  (SAS)  was  used  to  analyze  the  data  to  determine  if 
a  relationship  exists  between  innovation  adoption  and 
effectiveness.  Correlation  analysis  was  performed  using 
several  different  groups  of  variables.  Table  14  shows  the 
results  of  the  seven  adoption  categories,  RA,  VOL,  COM, 
FLEX,  SEE,  AVAIL,  and  IMAGE  with  the  fourteen  separate 
satisfaction  variables  of  Section  III.  Table  15  is  the 
results  of  the  seven  adoption  categories  with  the  three 
satisfaction  categories,  OVER,  REACT,  and  FELT.  It  also 
includes  the  all  encompassing  category  SATISFY.  Finally, 
Tables  16  and  17  are  the  correlation  analysis  of  all  the 
adoption  variables  as  a  whole,  ADOPT,  with  each  of  the 
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separate  satisfaction  variables,  the  three  satisfaction 
categories,  and  the  overall  category,  SATISFY. 


TABLE  14 

CORRELATION  ANALYSIS: 

7  ADOPTION  CATEGORIES  VS.  14  SATISFACTION  VARIABLES 
(PEARSON  CORRELATION  COEFFICIENT  /  PROB) 


EA _ 

VOL 

saa _ 

FLEX. 

SEE 

AVAIL 

IMAGE 

OVERALL 

.4815 

.0001 

-.1063 

.3576 

.5645 

.0001 

-.6886 

.0001 

.2612 

.0209 

.4068 

.0002 

.2243 

.0469 

STIM 

.4796 

.0001 

-.2119 

.0643 

.4972 

.0001 

-.5759 

.0001 

.2715 

.0162 

.2602 

.0223 

.2837 

.0113 

UNDER 

.2694 

.0171 

-.0049 

.9660 

.3573 

.0013 

-.6449 

.0001 

.2145 

.0610 

.2975 

.0091 

.1134 

.3227 

COURT 

.2699 

.0168 

-.0267 

.8189 

.3142 

.0051 

-.5989 

.0001 

.1238 

.2835 

.3482 

.0021 

.0834 

.4675 

HARD 

.2394 

.0336 

-.0502 
.  6644 

.2329 

.0388 

-.6823 

.0001 

.2754 

.0147 

.3531 

.0016 

.0460 

.6871 

IMPER 

.3020 

.0069 

-.0919 

.4263 

.2712 

.0134 

-.5723 

.0001 

.2244 

.0482 

-4131 

.0002 

.1068 

.3487 

FROST 

.2783 

.0130 

-.0734 

.5255 

.3866 

.0004 

-.7284 

.0001 

.1774 

.1203 

.2517 

.0272 

.1909 

.0918 

HASTE 

.5071 

.0001 

-.0089 

.9387 

.5309 

.0001 

-.5770 

.0001 

.3610 

.0012 

.4214 

.0001 

.0727 

.5243 

UNPRO 

.5315 

.0001 

-.0796 

.4911 

.5591 

.0001 

-.5931 

.0001 

.3144 

.0050 

.3098 

.0061 

.1189 

.2966 

DISTRACT 

.0111 

.9235 

.1180 

.3132 

.1562 

.1749 

-.4358 

.0001 

.0783 

.5015 

.2106 

.0697 

.1617 

.1600 

CONSTRA 

.0698 

.5492 

-.1849 

.1147 

.1651 

.1539 

-.3728 

.0009 

.0989 

.3987 

.3566 

.0018 

.0347 
.7  658 

OVERLOAD 

.1967 

.0864 

.1517 

.1760 

.2318 

.0425 

-.2358 

.0390 

.1679 

.1470 

.1987 

.0875 

-.0856 

.4592 

EXPRESS 

.2582 

.0243 

-.2471 

.0350 

.3747 

.0009 

-.1764 

.1301 

.2045 

.0804 

.0848 

.4723 

.0608 

.6041 

IMPRESS 

.3881 

.0005 

-.1302 

.2688 

.3777 

.0008 

-.1711 

.1394 

.4696 

.0001 

.3288 

.0042 

.1309 

.2596 
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CORRELATION  ANALYSIS: 

7  ADOPTION  CATEGORIES  VS-  4  SATISFACTION  CATEGORIES 
(PEARSON  CORRELATION  COEFFICIENT  /  PROS) 


RA 

YQL _ 

COM 

PLEX  SEE  AVAIL  IMAGE 

OVER 

.4617 

-.1034 

.5353 

-.7801 

.2703 

.4076 

.1327 

.0001 

.3739 

.0001 

.0001 

.0174 

.0003 

.2468 

REACT 

,4549 

-.0706 

.4892 

-.7722 

.3327 

.4285 

.1282 

.0001 

.5419 

.0001 

.0001 

.0029 

.0001 

.2600 

PELT 

.3209 

-.1106 

.4346 

-.4879 

.3388 

.4396 

.0973 

.0047 

.3514 

.0001 

.0001 

.0032 

.0001 

.4064 

SATISFY 

.4701 

-.1160 

.5465 

-.7782 

.3473 

.4898 

.1444 

.0001 

.3317 

.0001 

.0001 

.0026 

.0001 

.2196 

TABLE  16 

CORRELATION  ANALYSIS: 

"ADOPT"  VS.  14  SATISFACTION  VARIABLES 
(PEARSON  CORRELATION  COEFFICIENT  /  PROB) 

OVERALL 

STIM.  ■ 

omder 

COURT 

HARD 

I11££R 

gRGST 

.3528 

.4271 

.2222 

.2387 

.1420 

.2695 

.1896 

.0024 

.0002 

.0625 

.0450 

.2341 

.0220 

.1106 

WASTE 

UBfRO 

DISTRACT 

coasTSft 

OVERLOAD 

EXPRESS 

IMPRESS 

.4993 

.4451 

.0178 

.0235 

.1368 

.2505 

.4694 

.0001 

.0001 

.8837 

.8478 

.2586 

.0378 

.0001 
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TABLE  17 

CORRELATION  ANALYSIS: 

"ADOPT"  VS.  4  SATISFACTION  CATEGORIES 
(PEARSON  CORRELATION  COEPPICTENT  /  PROB) 


OVER  react  felt  satisfy 

.3761  .3849  .3124  .4089 

.0012  .0008  .0090  .0005 


Summary 

This  chapter  presented  the  demographic  breakdown  of  the 
survey  population,  the  means  and  standard  deviations  of  the 
responses,  and  the  Cronbach’s  alphas  establishing  the 
reliability  of  the  survey.  Also,  correlation  analysis 
tables  were  presented.  Chapter  V  will  address  these  results 
in  terms  of  conclusions  drawn. 
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gflnclusions  Recommendations 


T  nt  roduCt-lOB 


This  chapter  discusses  the  conclusions  that  have  been 
drawn  from  this  research,  based  on  the  results  displayed  in 
chapter  IV.  The  means  are  used  to  establish  the  adoption 
and  effectiveness  of  e-mail  and  the  correlation  coefficients 
are  used  to  address  the  research  objective  presented  in 
Chapter  I-  In  addition,  the  comments  provided  by 
respondents  to  the  survey  are  stunmarized .  A  recommendation 
for  further  research  in  this  area  is  also  presented. 


Conclusions 

Means .  Of  the  adoption  variables  (Table  10),  only  11 
out  of  36  yielded  mean  responses  slightly  on  the  lower  side, 
below  four,  of  the  scale.  There  were  no  means  on  the  low 
side  for  RELATIVE  ADVAHTAOE,  The  closest,  RA7 ,  dealt  with 
gaining  greater  control  over  one's  work  by  using  e-mail. 

All  means  within  this  area  indicate  an  overall  perception  by 
the  population  that  e-mail  is  an  advantage  to  them. 

Within  the  category  VOLUHTARINESS  the  mean  of  VOLl  was 
significantly  on  the  low  side  of  the  scale.  This  question 
dealt  with  the  boss’  expectations  of  e-mail  use,  where  as 
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VOL3,  the  next  lowest  mean  in  the  group,  dealt  with  the 
perception  of  the  boss  requiring  e-mail  to  be  used.  V0L2 
and  V0L4  substantiate  the  perception  that  the  use  of 
electronic  mail  is  seen  as  a  voluntary  exercise. 

The  COMPATIBILITY  category  yielded  means  all  above 
four,  with  COMl  as  the  lowest.  This  question  asked  if  e- 
mail  was  compatible  with  all  aspects  of  the  individual's 
work.  The  use  of  the  word  "all"  could  be  responsible  for 
this  lower  mean  as  the  other  three  COM  questions  produced 
high  means . 

COMPLEXITY  was  a  mix  of  high  and  low  means.  PLEXl , 

PLEX3,  and  PLEX4  showed  strong  agreement  with  the  ideas  that 
e-mail  is  cumbersome  to  use,  often  frustrating,  and 
difficult  to  get  it  to  do  what  the  user  wants.  However, 

PLEX2's  mean  indicates  that  it  does  not  require  a  lot  of 
mental  effort.  PLEX5  and  PLEX6  reinforce  PLEX2  with  means 
indicating  e-mail  ease,  both  in  learning  and  use.  So  while 
it  is  awkward  and  frustrating,  it  isn’t  perceived  as  very 
hard  to  use. 

The  variables  that  make  up  OBSERVABILITY  all  showed 
means  on  the  higher  side  of  the  scale.  This  is  an 
indication  that  respondents  perceive  widespread  use 
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of  electronic  mail  throughout  the  School  of  Systems  and 
Logistics . 

AVAILABILITY  (Trialibil ity)  had  only  one  of  its  four 
variables  indicate  a  high  mean.  AVAILl,  the  opportunity  to 
try  e-mail ,  recorded  the  highest  mean  on  this  portion  of  the 
survey.  AVAIL2  through  AVAIL4,  which  dealt  with  trying  it 
out  before  actually  using  it,  all  yielded  low  meaois .  This 
would  suggest  the  desire  to  experiment  with  electronic  mail 
for  a  period  prior  to  being  actually  on  line. 

The  final  adoption  factor,  IMAGE,  had  all  of  its  four 
facjtors  produce  significantly  low  means.  This  supports  the 
conclusion  that  electronic  mail  is  n,ot  perceived  to  enhance 
image  within  the  LS  faculty  or  staff.  Individuals  are  not 
perceived  to  gain  in  status  by  using  e-mail . 

Overall,  the  means  indicate  the  perceived  adoption  of 
electronic  mail  by  the  LS  faculty  and  staff-  While 
AVAILABILITY  and  IMAGE  registered  low  means,  key  factors, 
such  as  RELATIVE  ADVANTAGE,  VOLUNTARINESS,  COMPATIBILITY, 
and  OBSERVABILITY,  all  yielded  high  means.  It  isn't  seen  as 
a  status  symbol,  but  is  perceived  as  a  benefit  to  one's  work 
and  widely  used  by  the  organization.  E-mail  is  also 
perceived  as  frustrating  and  there  is  a  perceived  need  for 
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more  learning  prior  to  use.  These  issues  are  better 
addressed  by  responses  to  the  satisfaction  with  the  system 
section  and  the  comments  section  of  the  survey. 

The  responses  to  questions  in.  Section  III  (Table  11)  of 
the  survey  were  split  more  decisively  than  in  Section  II. 

Of  the  fourteen  variables,  eight  produced  means  on  the  lower 
side  of  the  scale.  Respondents,  on  the  average,  felt  that 
the  system  they  used  for  electronic  mail  was  more  boring 
than  stimulating;  used  more  unfriendly  language  than 
courteous;  was  hard  to  learn;  impersonal;  and  frustrating  to 
use.  They  also  leaned  toward  the  "Always”  side  of  the  scale 
in  feeling  distracted  by  the  system's  mechanics  and 
constrained  in  the  types  of  contributions  they  could  make 
with  e-mail.  In  addition,  the  mean  indicates  an  inability 
to  get  an  impression  of  personal  contact  from  e-mail  use. 

From  this  preliminary  means  analysis,  it  can  be 
concluded  that  electronic  mail  has  been  adopted  into  the 
School  of  Systems  and  Logistics.  However,  the  satisfaction 
with  the  current  electronic  mail  systems  is  still  quite 
split.  The  next  two  sections  discuss  the  correlation 
analysis  results  and  respondents'  comments.  These  shed  some 
light  on  the  satisfaction  area. 
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Correlatjjan  Coefficients .  Tables  14  tbcougb  17  show 
the  results  obtained  by  the  various  correlation  analyses, 
performed.  Correlation  analysis  between  the  7  adoption 
categories  and  the  14  satisfaction  variables  (Table  14) 
indicated  that  RELATiViS  ADVANTAGE  (RA) ,  COMPATIBILITY  (COM), 
COMPLEXITY  (PLEX),  OBSERVABILITY  (SEE),  and  TRIALIBILITY 
(availability)  correlated  with  a  majority  of  the 
satisfaction  variables,  at  the  .05  significance  level. 
COMPLEXITY  yielded  very  strong  negative  correlation 
coefficients  with  all  but  two  of  the  satisfaction  variables, 
express  and  IMPRESS. 

The  same  conclusions  can  be  drawn  by  looking  at  Table 
15.  The  7  adoption  categories  versus  the  4  satisfaction 
categories  analysis  resulted  in  the  same  5  adoption 
categories  yielding  high  correlation  coefficients.  Again, 
COMPLEXITY  produced  distinct,  negative  correlation 
coefficients.  These  five  areas  would  seem  to  be  the 
adoption  areas  influencing  user  satisfaction  with  e-mail  the 
most . 

Taking  the  adoption  variables,  as  a  whole,  versus  the 
14  satisfaction  variables  (Table  16),  5  significant 
correlations  resulted.  The  overall  impression  of  the 
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system;  its  ability  to  stimulate  the  user;  its  impression  of 
saving  time;  its  impression  of  being  productive;  and  its 
ability  to  give  an  impression  of  personal  contact  all 
yielded  significant  correlation  coefficients.  These  five 
areas  would  seem  to  be  the  influencing  areas  for  electronic 
mail  adoption. 

The  combined  variables  correlation  analysis  (Table  17) 
yielded  significant  coefficients,  the  highest  being  the 
ADOPT  versus  SATISFY.  This  final  coefficient  does  suggest 
that  there  is  a  connection  between  innovation  adoption  and 
user  satisfaction  with  an  electronic  mail  system. 

The  purpose  of  this  research  was  to  investigate  the 
possible  relationship  between  adopting  an  information 
technology  innovation  and  the  effectiveness  of  that 
innovation.  Significant  correlation  coefficients  have  been 
shown  that  suggest  a  relationship  does  exist  between  certain 
innovation  adoption  factors  and  certain  system  satisfaction 
variables  used  as  surrogate  measures  of  effectiveness. 


As  an  addition  to  the  survey's  two  main  sections,  a 


comnents  section  was  provided  to  allow  respondents  the 
opportunity  to  highlight  any  concerns  not  covered  by  the 
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adoption  or  the  satisfaction  sections.  Over  half  of  those 
who  responded  made  comments.  Comments  received  were  grouped 
into  similar  areas  and  are  siimmarized  briefly  within  this 
section. 

Comments  ranged  from  "I  like  it,  but  I'm  not 
connected,"  to  "I  have  no  use  for  e-mail  or  computers- -Can 
you  get  this  thing  off  my  desk!!."  Comments  were  equally 
split  between  liking  e-mail  and  hating  it.  Many  who  liked 
it  had  ideas  for  improving  it,  though. 

These  ideas  included  making  e-mail  use  mandatory 
throughout  the  School  of  Systems  and  Logistics;  cutting  down 
the  amount  of  "junk";  and  adding  more  training  for  users. 

The  need  for  good  documentation,  such  as  a  clear  user's 
manual,  was  expressed  several  times. 

Those  who  reported  dislike  for  electronic  mail  had  some 
constructive  ideas  for  its  improvement,  also,  one  major 
complaint/suggestion  dealt  with  the  number  of  key  strokes 
needed  to  operate  the  Q-Office  system-'"Weak  menus  detar  use 
and  fewer  key  strokes  are  needed!!"  Remarks  were  evenly 
divided  between  positive  and  negative  conments.  The 
comments  reinforce  the  idea  that  e-mail  has  become  a  part  of 
AFIT/LS  and  the  faculty/staff  ate  interacting  with  it. 
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Recommendation  for  Funthey  Research 

As  stated  in  Chapter  II,  actual  usage  data  is  another 
means  of  measuring  system  effectiveness.  This  is  an  area 
that  could  be  researched  further.  A  research  project 
totally  devoted  to  establishing  e-mail  effectiveness  at  APIT 
would  certainly  require  this  data.  In  addition,  it  may 
provide  further  evidence  of  a  relationship  between 
innovation  adoption  and  innovation  effectiveness. 

Summary 

As  budgets  shrink,  organizations,  such  as  AFIT,  must 
ensure  that  the  equipment  they  possess  is  being  used  to  its 
fullest  extent.  An  e-mail  system  cannot  function  to  its 
fullest  potential  if  it  is  not  used.  Knowing  what  areas 
cause  an  organization  to  adopt  an  innovation,  and  how  those 
areas  relate  to  the  users'  satisfaction  with  that  innovation 
can  signal  the  direction  for  improvements  to  that 
innovation.  This  can  result,  ultimately,  in  better  use  of 
the  innovation  in  the  long  run. 
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hPV^Xi^in  A:  S-Ucygy  Instrxunent 

This  is  the  survey  instrument  that  was  sent  to  the 
entire  LS  faculty  and  staff.  A  total  of  150  surveys  were 
sent  out. 

Section  I  of  the  survey  consists  of  9  questions 
designed  to  collect  background  demographic  type  information. 
Section  II  is  the  innovation  adoption  measurement  instrument 
developed  by  Moore  and  Benbasat.  Section  III  consists  of 
the  14  system  satisfaction  questions  from  the  Hiltz,  Kerr, 
and  Johnson  instriunent.  The  last  section  allowed 
respondents  the  opportunity  to  make  their  own  comments 
concerning  e-mail  at  AFIT. 
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DEPARTMENT  OF  THE  AIR  FORCE 

AIR  UNIVERSITY 

AIR  FORCE  INSTITUTE  OF  TECHNOLOGY 
WRIGHT-PATTERSON  AIR  FORCE  BASE  OH  4S433-6S83 


ATTNOF  LS  (Captain  White,  255-8989)  5  JUL  1991 

SUBJECT  Electronic  Mail  Questionnaire 

TO: 


1.  Please  take  the  time  to  complete  the  attached  questionnaire 
and  return  it  in  the  attached  envelope  by  12  July  1991. 

2.  The  purpose  of  this  questionnaire  is  to  gather  information 
about  electronic  mail  and  its  use  in  the  School  of  Systems  and 
Logistics.  The  data  gathered  will  become  part  of  an  AFIT 
research  project  and  may  help  to  identify  strengths,  weaknesses, 
and  possible  improvements  to  our  present  systems.  Your  responses 
will  be  kept  completely  confidential  and  will  be  used  only  in 
combination  with  those  of  other  participants. 


3.  Your  participation  is  completely  voluntary,  but  we  would 
appreciate  your  help.  For  further  information,  please  contact 
Major  Roger  Koble  at  255-4845. 


3  Atch 

1.  Questionnaire 

2.  AFIT  Form  IIC 

3.  Return  Envelope 
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STRENGTH  THROUGH  KNOWLEDGE 


APIT  SCN  9101 


GeneraLl  Instructions 

1.  Please  answer  each  question  as  best  as  you  can  and 
select  only  one  answer  to  each  question.  If  for  any  reason 
you  don't  understand  a  question  or  don’t  want  to  answer, 
just  skip  it  and  go  to  the  next  one. 

2.  Responses  will  be  machine  scored  so  please  mark  your 
answers  on  the  answer  sheet  provided.  The  usual 
instructions  apply  --  No.  2  pencil,  blacken  appropriate 
circle,  erase  any  stray  marks,  don't  fold  the  answer  sheet, 
etc.  Sone  questions  may  also  require  a  written  response,  in 
addition  to  an  answer  sheet  response. 

3.  The  last  section  will  give  you  the  opportunity  to  speak 
out  on  anything  we  may  have  missed  or  elaborate  on  any 
points  you  wish  to  make.  Also  feel  free  to  use  the  comments 
section  to  give  feedback  on  this  survey. 

4.  When  you  have  completed  it,  please  ptit  the  questionnaire 
and  answer  sheet  in  the  envelope  provided. 


Wliat  is  your  e-mail  user  ID  login  (ie  DWHITE)?  _ 

One  issue  this  study  is  investigating  is  the  relationship 
between  attitudes  and  actual  use  of  electronic  mail.  Since 
frequency  data  are  available  by  user  ID,  this  information 
will  permit  a  more  complete  understanding  of  electronic  mail 
use  by  AFIT/LS  faculty  and  staff. 

If  you  are  not  comfortable  giving  your  user  ID,  feel  free  to 
leave  it  blank,  but  we  ask  that  you  please  complete  the 
questionnaire . 


Thank  you  for  participating. 
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I.  Background 


This  section  asks  for  some  background  information. 
These  items  will  provide  overall  demographic  information 
about  the  AFIT/LS  faculty  and  staff. 

1.  In  which  branch  do  you  currently  serve? 

1.  Air  Force 

2 .  Army 

3 .  Navy 

4.  Marines 

5 .  Coast  Guard 

6.  Not  applicable,  civilian 

2.  What  is  your  designation  and  grade? 


1, 

Civilian,  grade: 

(  ie 

GS-07) 

2. 

Enlisted,  grade: 

( ie 

E-5) 

3  . 

Officer,  grade: 

(ie 

0-3) 

3.  What  is  your  gender? 

1.  Female 

2.  Male 

4.  What  is  your  age? 


1 . 

Less 

than  20 

21  - 

30 

3  . 

31  - 

40 

4. 

41  - 

50 

5. 

51  - 

60 

6. 

Over 

60 

5.  What  is  your  highest  level  of  education? 

1.  Less  than  a  high  school  diploma 

2.  High  school  or  graduate  equivalent  diploma 

3.  Some  college  courses  but  no  college  degree 

4.  Associate's  degree  or  equivalent 

5.  Bachelor's  degree  or  equivalent 

6.  Master's  degree 

7.  Graduate  work  beyond  Master’s  degree  (doctoral 
candidate,  dissertation  not  complete) 

8.  Doctoral  degree  (Ph.D,  J.D.,  D.B.A.,  or  equivalent) 
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6.  What  is  your  academic  rank? 


1. 

Instructor 

2. 

Assistant  professor 

3. 

Associate  professor 

4. 

Professor 

5. 

Not  applicable 

In 

which  programs  do  you 

teach? 

1 . 

PCE  only 

^  . 

Mostly  PCE,  but  some 

graduate 

3. 

About  equal  time  in  : 

PCE  and  graduate 

4. 

Mostly  graduate,  but 

some  PCE 

5. 

Graduate  only 

6. 

Not  applicable 

8.  How  many  years  have  you  served  on  the  AFIT 

faculty/staff  (i.e.,  total  years  to  include  any 
previous  military  assignments  to  the  AFIT 
faculty/staf f )? 


1. 

Less 

than  01 

2. 

01  - 

02 

3. 

02  - 

04 

4. 

04  - 

05 

5. 

05  - 

10 

6  . 

10  - 

15 

7  . 

1  r  - 

20 

8. 

Over 

20 

9.  What  system  do  you  primarily  use  for  electronic  mail? 

1.  Blackbird  (ssc) 

2.  Cluster  (isc  or  esc) 

3 .  Galaxy  ( Icc) 

4.  Phantom  (q-office) 

5.  Other  _ 

6.  Do  not  use  electronic  mail 
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XI-  adqBt.if3D  ^  Electronic  Mail 


This  section  asks  for  your  opinions  about  electronic 

mail . 

For  each  item,  use  the  following  scale  to  rate  your 
level  of  agreement/disagreement . 


I - 2 - 3 - 4 - 5 - 6 - 7 

Strongly  Neither  Strongly 

Disagree  Agree  nor  Disagree  Agree 


Relative  Advantage :  the  degree  to  which  you  perceive 
electronic  mail  as  being  better  than  its  alternatives. 

10.  Using  e-mail  enables  me  to  accomplish  tasks  more 
quickly . 

11.  Using  e-mail  improves  the  quality  of  my  work. 

12.  Using  e-mail  makes  it  easier  to  do  my  job. 

13.  Using  e-mail  improves  my  job  performance. 

14.  Overall,  I  find  using  e-mail  to  be  advantageous  in  my 
job . 

15.  Using  e-mail  enhances  my  effectiveness  on  the  job. 

16.  Using  e-mail  gives  me  greater  control  over  my  work. 

17.  Using  e-mail  increases  my  productivity. 

Voluntariness :  the  degree  to  which  use  of  electronic  mail 

is  perceived  as  being  voluntary,  or  of  free  will. 

13.  My  superiors  expect  me  to  use  e-mail. 

19.  My  use  of  e-mail  is  voluntary  (as  opposed  to  required 
by  my  superiors  or  job  description). 

20.  My  boss  does  not  require  me  to  use  e-mail. 

21.  Although  it  might  be  helpful,  using  e-mail  is  certainly 
not  compulsory  in  my  job. 
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strongly 

Disagree 


Neither 

Agree  nor  Disagree 


Strongly 

Agree 


Compatibility:  the  degree  to  which  electronic  mail  is 

perceived  as  being  consistent  with  the  existing  values, 
needs,  and  past  experiences. 

22.  Using  e-mail  is  compatible  with  all  aspects  of  my  work. 

23.  Using  e-mail  is  completely  compatible  with  my  current 
situation . 

24.  I  think  using  e-mail  fits  well  with  the  way  I  like  to 


25.  'Jsi..o  e-mail  fits  into  my  work  style, 


Complexity :  the  degree  to  which  electronic  mail  is 

perceived  as  being  easy/difficult  to  use. 

25.  I  believe  that  e-mail  is  cumbersome  to  use. 

27.  My  using  e-mail  requires  a  lot  of  mental  effort. 

28.  Using  e-mail  is  often  frustrating. 

29.  I  believe  that  it  is  easy  to  get  e-mail  to  do  what  I 
want  it  to  do. 

30.  Overall,  I  believe  that  e-mail  is  easy  to  use. 

31.  le.arning  to  use  e-mail  was  easy  for  me. 


Observability:  the  degree  to  which  the  results  of  using 

electronic  mail  are  observable  to  others. 

32.  I  have  seen  what  others  do  using  e-mail. 

33.  I  have  seen  e-mail  in  use  outside  my  organization. 

34.  2:-mail  use  is  no very  visible  in  my  organization. 
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For  each  item,  use  the  following  scale  to  rate  your 
level  of  agreement/disagreement. 

I - 2 - 3 - 4 - 5 - 6 - 7 

Strongly  Neither  Strongly 

Disagree  Agree  nor  Disagree  Agree 

35.  It  is  easy  for  me  to  observe  others  using  e-mail  in  my 
organization. 

36.  I  have  had  plenty  of  opportunity  to  see  e-mail  being 
used . 

37.  I  have  not  seen  many  others  using  e-mail  in  my 
organization. 


Availability:  the  degree  to  which  electronic  mail  may  be 

e.xperimented  with  on  a  limited  basis. 

38.  I've  had  a  great  deal  of  opportunity  to  try  e-mail. 

39.  Before  deciding  whether  to  use  e-mail,  I  was  able  to 
properly  try  it  out. 

40.  I  was  permitted  to  use  e-mail  on  a  trial  basis  long 
enough  to  see  what  it  could  do. 

41.  I  am  able  to  experiment  with  e-mail  as  necessary. 


Image :  the  degree  to  which  use  of  electronic  mail  is 

perceived  to  enhance  image  or  status. 

42.  Using  e-mail  improves  my  image  within  the  organization. 

43.  People  in  my  organization  who  use  e-mail  have  .more 
prestige  than  those  who  do  not. 

44.  People  in  my  organization  who  use  e-mail  have  a  high 
profile. 

45.  Using  e-mail  is  a  status  symbol  in  my  organization. 
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III.  Satisfaction  with  Electronic  Mail 

This  section  asks  about  your  satisfaction/ 
dissatisfaction  with  the  electronic  mail  system  you  use. 


For  each  item,  use  ^ 
opinion. 

the  scale  given 

to 

rate  your 

46. 

Overall,  the  system 

is  .  .  . 

1  _ _  n  '> 

5 

r 

J.  Z  O 

Extremely 

Oood 

Neutral 

Extremely 

Bad 

47  . 

I  find  using  the  system  to  be... 

A 

5 

X  ^ 

Stimulating 

Neutral 

Boring 

48  . 

I  find  the  language 

of  the  system. . 

• 

5 

C  '7 

L  ^  O 

Understandabl e 

"  n  -  —  — 

Neutral 

Confusing 

49. 

I  find  the  language 

of  the  system. . 

• 

1 - 2  - 3 

—  —  *  _  __ 

5 

j 

Courteous  Neutral  Unfriendly 


Please  indicate 

your 

reactions  to 

using  “rhis  system: 

50  . 

« —  A  —  —  - 

c.  —  A  - 

*7 

X  -  —  —  --  ^ 

Hard  to  learn 

■  -  J 

Neutral 

Easy  to 

1  ^  3, 1.'  ri 

51. 

1  -  -  0  -  -  - 

.  —  ^  —  A  -  -  - 

c.  c 

"7 

X  *"  "  ^  - 

Impersona  1 

0 

Neutral 

Fri 

endl  y 

52  . 

«.  g _ 

X  "  ~  ~  ' 

Frustrating 

0 

Neutral 

Not  frustr 

a  ting 

53  . 

Time  wasting 

0 

Neutral 

0  u 

3 

av  ii)g 

54. 

Unproductive 

0 

Neutral 

-  0  —  -  w - 

?  r  cdu 

c  t  i '/  e 
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For  each  item,  use  the  following  scale  to  rate  your 
opinion . 


- 2 - 3 - 4 - 5 - 6 - 7 

Always  Sometimes  Never 


How  frequently  have  you  felt... 

55.  ...distracted  by  the  mechanics  of  the  system? 

56.  ...constrained  in  the  types  of  contributions  you  could 
make? 

57.  ...overloaded  with  information? 

58.  ...able  to  e.xpress  your  views? 

59.  ...able  to  get  an  impression  of  personal  contact? 


58 


IV. 


Please  use  this  section  to  make  any  comments  or 
suggestions  that  may  benefit  the  faculty  or  the  Institute. 
Any  comments  you  make,  like  the  rest  ot  this  questionnaire, 
will  be  strictly  anon’mjus. 


Thank  you  for  your  input  and  assistance. 
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Appendix  B'-  Raw  Data 


This  is  the  raw  data  for  the  80  valid  cases  used  in 
this  research.  Data  format  is  as  follows: 

1.  Each  case  is  displayed  on  two  lines. 

2.  The  first  line  contains  a  four  digit  identification 
number  assigned  for  tracking  purposes. 

3.  The  second  line  contains  the  responses  in  the 
numerical  order  of  each  question  (that  is,  column  1  =  the 
response  to  question  1,  column  2  =  the  response  to  question 
2 ,  etc . ) . 

4.  If  there  was  no  response  to  a  question,  the  field 


contains  a  period. 


0001 

13137123455555555711177774333445534417117777444544443566414 

0002 

61258456411111111716511117771116616526116111777771111111111 

0003 

61247212464545434643455553454356335536555434433333535544444 

0004 

61246225445656646555533533444445535436545425224553335524344 

0005 

13238242555545555711146445375555633335553333355673222414146 

0006 

61258355275747677177727773173357777757777111155246516542262 

0007 

13238243465556555733345553355554534537546444433445445545336 

0008 

61153568444444444177722226662246662262262222266554444442222 

0009 

61146345453625636553313557672215525527325111165751326524356 

0010 

61246427444445545666422456672235533247223434254543335532636 

0011 

13148254474656546554556773225555645536666543323235456655533 

0012 

612684584141111115.  .  Ill44711457  41411444444111541454444'44144 
0013 

61268248477777777177767772137637732537717444422244456642623 

0014 

13238251154546535576633555453333535545555333353. . 3335533535 
0015 

13247152275767666644377772236676716627446434323236467767522 

0016 

132382  414556666565655345  633345555355353354333333  3  333  65  4  4  5.3  2 
0017 

33237224444445544771253444156676626526667656534447655444554 

0018 

13236112455555555524455553335554444445555411133333344453355 

0019 

61123561444444557772477774454676315647637711413444447643433 

0020 

6125731544444655571116666111555. . 111.6665.1.236444456643344 
0021 

13246225463565536622222566453347435525226533255343422534646 

0022 

61256225466667667444466662225664424426446221113336666766762 


61 


0023 

61268357444425422533366226462336242266446212144334444444245 

0024 

61238455611111111177711114444441134276445111147444444477777 

0025 

13236121274767645622266665454457727717336111144454444444444 

0026 

13236111465655566464633557363335543445435444435555235514543 

0027 

61158445444445444567654346163352222246111111146244422442427 

0028 

13248355411111111177711117571146776776666177757742111177177 

0029 

13248255456657666477766772236665335636666655533326555655624 

0030 

13237151444443443356644445553332643343224333345543354433446 

0031 

13248251464555545266622557664216454535222212165772425523655 

0032 

61248254443333322455644335443335434435334222247553333333533 

0033 

6125835246464.433577777775224565717717. .74141242354555645.3 
0034 

61256325464435432555512443353533415515555554433345555675544 

0035 

13244561444443333377733333335535575315335777744444555535344 

0036 

61238325477767764474777776266664454435117444424223446644324 

0037 

13226563465657655445355663125566426627747226224245446646633 

0038 

61153567466667777771766662156666226626326622233334444544444 

0039 

. . 266428443445444751133436272353264446234333355445433433445 
0040 

13226213454555545655544441145666626626444222234336555535655 

0041 

23236113443556666653233665354533655526112445455553333533543 

0042 

13246123444446444677277771225667717717125222233125566655624 

0043 

6124832545455555563332.556662225235535535553535771321322233 

0044 

13236223454445444576644445453334525526555422244443444445544 


62 


0045 

61246113411111111557722222225554274422277211144344444455636 

0046 

6112256146476665674116677111777442462GG36644422117776G65534 

0047 

61268425442324222711142442254566626626311111164456334424146 

0048 

61258436433333333454434557671114453345113111177442211144146 
:  ">49 

i-,13715146455545556466666223555443442  64454444345434566452  45 
0050 

13247243454445444266655454453436636634326444443553334443445 

0051 

61233563444444444664644444574334434446666344445543444433644 

0052 

61268418455555555676644444474466652241112166644642224442266 

0053 

6112356544454543  454151444617267611451777711114423641433 . 3.  . 
0054 

13238242275767545566666661126666644624324434224147467754444 

055 

12222563466554434346355435113444444466556111147444243414577 

0056 

132361 431777777777111777711177777177177777 6751122 0667766511 
0057 

61252564461113111444111114444444141444446111144444444445444 

0058 

33236243232444445634554451116662163217532411124443354576436 

0059 

13248345456656665761144665276567715627777211134225646646622 

0060 

51268423444344322543544433352434214525434444434444443344244 

0061 

1323. . . .444414444177.76665471155514445444111134471113511742 
0062 

61243336465656555761156663236645555436345455323325566655433 

0063 

13238243455545555455555555353335335535335555453661325534555 

0064 

612564284766676676767666671735575166166.6555555663223342374 

0065 

13246123355545566455555665455555354546546545434443433443335 

0066 

61266328465666656464645662266666216616666444444227777742412 


63 


0067 

13126223445444544653533445353356635525555444434125534444353 

0068 

13238345463566526761222553333555555355225444233552325533333 

0069 

13235563555545445644235447773245744455225444446353331244354 

0070 

61246215444333333522255556444444427244444544444444444444444 

0071 

13236113412121131113322667463236535346556666655662336634544 

0072 

61254565622222222247722227444445544445551211647444442771755 

0073 

61246213433333333  4443455454523533256252  3  44444335433334 . 

0074 

61248344464757426563666665473377177174446111154653434427514 

0075 

3323611147  44455  4532365445343444 . 7  24454444444442  4445  4443 

0076 

111625684443254446422444436344422422342644244445444444 . 

0077 

13238121277777777711177T76152235756737666111134541347756512 

0078 

6112 3565 433 33 3333 37 77 222262145722 44347 117111144444444 44 4 444 
0079 

62247214455555555544445554454445536636445444444444444444444 

0080 

61246214442334322542511426732331262279116264253542332332266 
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